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(57) ABSTRACT 

A data elementary buffer with underflow and overflow 
operational constraints is incorporated into a digital televi- 
son receiver to regulate the flow of data related to an 
ancillary data service to be presented in synchronization 
with a video or audio program element. The data elementary 
buffer ensures that data is received in time for decoding and 
presentation in synchronization with the video or audio 
element. ITae data elementary buffer also limits the amount 
of data that the receiver may be required to cache. The 
minimum size of the data elementary buffer is three times 
the size of a nominal data access unit or three times the 
quantity of data that the receiver can receive at the maximum 
rate in the period that a video element is displayed by the 
receiver. 

9 Claims, 2 Drawing Sheets 
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BUFFER SYSTEM FOR CONTROLLED AND form, is expected to include data and system specifications 

TIMELY DELIVERY OF MPEG-2F DATA 'o facilitate data transmission in a manner compatible with 

SERVICES digital multiplex bit streams of ISO/IEC 13818-1 

(MPEG-2 Systems) used in digital television video broad- 

This application claims the benefit of U.S. Provisional 5 casting. The specification is also expected to describe 

Application No. 60/096,783, filed Aug. 7, 1998. mechamsms necessary to permit ancillary data to be asso- 

» » o ciated with particular audio or visual content m a television 

BACKGROUND OF THE INVENTION broadcast. 

The ATSC DIGITAL TELEVISION STANDARD 

The present invention relates to digital television (DTV) describes a model for a hypothetical ancillary services target 

and, more particularly, to a buffer system for a DTV receiver system decoder for a DTV receiver. This idealized decoder 

useful in presenting broadcast data services synchronized to jg modeled after a conceptual model for a transport stream 

the audio or visual content of a digital television program. system target decoder (T-STD) described in the ISO/IEC 

A digital television system includes a transmitter and a 138 18-1: 1996 (MPEG-2) standard. The MPEG-2 conceptual 

receiver which assemble programs comprising audio, video, T-STD model comprises an individual system target decoder 

and ancillary components for coordinated presentation to a for each of the elementary data streams representing the 

user. The transmitter system includes subsystems to receive video, audio, and system information components of a 

and compress the digital source data (the elementary or television program. However, the MPEG-2 system specifi- 

application data streams representing a program's audio, cation does not define a system target decoder for ancillary, 

video, and ancillary data components); multiplex the data synchronized data services. 

from the several elementary data streams into a single The ATSC model ancillary services target system decoder 

transport bit stream; and transmit the data to the receiver. At includes a buffer system linking the receiver's transport 

the receiver the transport bit stream is demultiplexed into its stream demultiplexer with the application decoder for the 

constituent elementary data streams. The elementary data specific type of elementary data stream being decoded. The 

streams are decoded and the audio and video data streams 25 transport stream demultiplexer separates and reconstructs 

are delivered as synchronized program elements to the the several elementary streams from the single multiplexed 

receiver's presentation subsystem for display as parts of a MPEG-2 transport bit stream. The application decoders 

coordinated television program. The digital television sys- decode the data elements or access units making up the data 

tem is described by the ATSC DIGITAL TELEVISION elementary streams in preparation for presentation to the 

STANDARD, Advanced Television Systems Committee, 3Q user. The ATSC model ancillary services target decoder, as 

Doc A/53, Sep. 16, 1995 incorporated by reference herein. well as the decoder described in the European Digital Video 

The system employs the MPEG-2 systems and video stream Broadcasting Consortium (DVB) specification, are two 

syntax of ISO/IEC 13818-1 & 2, INFORMATION buffer systems with a 512-byte transport buffer followed by 

TECHNOLOGY— GENERIC CODING OF MOVING a smoothing buffer. 

PICTURES AND ASSOQATED AUDIO INFORMAHON, 35 For synchronized presentation of streaming data the DTV 

International Standards Organization, 1995, Sep. 16, 1995, receiver must be able to collect the packets of data, reas- 

incorporated by reference herein. Audio coding is in accor- semble them into data access units (an elemental imit of data 

dance with the DIGITAL AUDIO COMPRESSION STAN- to be decoded and presented in association with an instant of 

DARD (AC-3), Advanced Television Systems Committee, a video or audio program), and send them to the application 

Doc A/52, Nov. 16, 1994, Dec. 20, 1995, incorporated by 40 decoder that is processing the data and converting the data 

reference herein. to a form suitable for presentation at the desired time instant. 

In addition to the basic audio and video content of a If the receiver receives the data earlier or at a faster rate than 
televison program, digital television provides the opportu- required, the excess data must be stored in a buffer. On the 
nity to augment televison programming with a range of other hand, sufficient data must be readily available in the 
ancillary data services. Ancillary data services described in 45 receiver or the presentation will not be smooth and properly 
the ATSC DIGITAL TELEVISION STANDARD include synchronized to the video or audio content, 
control data; conditional access control data associated with The ATSC model for an ancillary service target decoder 
limited access to scrambled signals; and data associated with consists of a transport demultiplexing buffer and a smooth- 
program audio and video services such as "closed ing buffer. However, there is no buffer for reconstructing 
captioning," emergency broadcasts, and a program guide 50 data access units to be decoded and then presented in 
containing information about the audio, video, and data synchronization with the audio or visual elements of a 
contentof programs being transmitted or to be transmitted in program. Likewise, the size of a data access unit, the 
the future. frequency of transmission of data access units, and the 

In addition to these basic ancillary data services, the method of synchronization is not established by the ATSC 

digital televison standard envisions the broadcast of addi- 55 DIGITAL TELEVISION STANDARD and not contem- 

tional ancillary or private data services. The contents of plated by the MPEG-2 specification. Derivation of the 

these services are to be defined in the future by developers general T-STD model for all kinds of ancillary data is not 

of digital television content. These data services can include straightforward because the decoding model for ancillary 

asynchronous, synchronous, and synchronized streaming data can be anything from simple to complex. As a result, the 

and non-streaming data. Synchronized streaming and non- 60 quantity of data the receiver may be required to cache might 

streaming data afford the opportunity to provide data ser- exceed its capacity (a condition of memory overflow) or 

vices that are associated with a particular audio or visual throughput capabilities. Alternatively, the receiver may fail 

instant of a television program. The suite of ATSC digital lo receive all of the data in a data access unit in time for 

television standards will include a specification for data decoding and synchronized presentation with a specified 

broadcasting drafted by the T3S13 working group of the 65 instant in the audio or video data streams resulting in a loss 

Advanced Television Systems Committee, lliis ATSC of data and inconsistent performance (a condition of 

DATA BROADCAST SPECIFICATION, currently in draft memory underflow). 
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What is desired, therefore, is a buffer system for an 
ancillary service target decoder for synchronized data ser- 
vices that establishes the size limits of a data access unit for 
those services and enforces a transmission schedule on the 
MPEG-2 multiplexer of the transmitter or emission station 
such that the data arrives in time for proper synchronized 
presentation but in a quantity and at a rate which will not 
overwhelm the receiver so no data is lost. 

SUMMARY OF THE INVENTION 
The present invention overcomes the aforementioned 
drawbacks of the prior art by providing a buffer mechanism 
to regulate delivery of data for synchronized presentation by 
a digital television receiver that includes a smoothing buffer, 
the buffer mechanism comprising a data elementary buffer 
constrained to operate without overflow and underflow of 
data, to receive the data from the smoothing buffer. Further, 
the size of the data elementary buffer is a function of the 
quantity of data that can be received by the receiver in the 
period in which it displays a video element, such as a frame 
or a field. 

A complete target system decoder for a synchronized 
ancQlary data service for a digital television receiver is 
specified comprising a transport buffer receiving transport 
stream data packets for the synchronized ancillary data 
service from a transport stream demultiplexer; a smoothing 
buffer receiving transport stream data packets from the 
transport buffer at a transport buffer leak rate; a first- in, 
first-out data elementary buffer, constrained to operate with- 
out overflow and underflow of data, receiving elementary 
data stream packet payload data from the smoothing buffer 
at a smoothing buffer leak rate and aggregating the elemen- 
tary data stream packet data to reconstruct a data access unit; 
and an application decoder receiving the data access unit 
from the data elementary buffer at a specified time. 

Further, a method of buffering data for synchronized 
presentation with an instant of a visual or audio data stream 
by a digital televison receiver is provided comprising setting 
an appropriate size for a data elementary buffer to aggregate 
data to reconstruct an access unit of data, the data elemen- 
tary buffer being constrained to operate without overflow or 
underflow of data; removing an access unit of data from the 
data elementary buffer for presentation at a removal time 
correlated with a presentation time stamp included in the 
visual or audio data stream; and adding data to the data 
elementary buffer from a smoothing buffer. 

The buffer of the ancillary service target decoder causes 
the flow of data from the DTV transmitter to the receiver to 
be regulated so that data to be presented in synchronization 
with an instant of an audio or visual element of the program 
will be available in the ancillary data services application 
decoder in time to be decoded and presented in coordination 
with the corresponding instant of the visual or audio pro- 
gram element. The operating constraints of the data elemen- 
tary buffer impose conditions that must be observed by the 
multiplexer system at the emission station to prevent over- 
flow of data which would result in the loss of data. The size 
of the data elementary buffer limits the quantity of data that 
can be held at the receiver and, therefore, the period of time 
the data can be held before decoding. A minimum time 
interval between removal of two consecutive data access 
units provides an upper bound on the data transfer capabili- 
ties to be supported in data receivers. 

The foregoing and other objectives, features and advan- 
tages of the invention will be more readily understood upon 
consideration of the following detailed description of the 
invention, taken in conjunction with the accompanying 
drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a digital television transmit- 
ter and receiver. 
J FIG. 2 is a block diagram of an ancillary data service 
target decoder according to the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

■^Q Referring to FIG. 1, a digital television system comprises 
a transmitter 2 or emission station and a receiver 4. The 
transmitter 2 includes facilities to receive a plurality of 
streams of digital source data 6, each stream representing a 
video, an audio, or an ancillary data services component of 

j5 a television program. AnciUary data services described in 
the ATSC DIGITAL TCLEVISION STANDARD include 
control data, conditional access data which scrambles the 
program unless the decoder has the proper key, and data 
associated with program audio and video services, such as 

20 system information for acquiring the program elements, 
information for a program guide, emergency messages, and 
"closed captioning" services. 

In addition to the basic ancillary data services, the ATSC 
standard envisions the broadcast of additional ancillary or 

25 private data services. The scope of private data services is 
expected to be defined in the future as new uses and features 
are developed for the digital television system. For example, 
such services might include interactivity features permitting 
the user to respond to the video and audio content of a 

30 television program. The ATSC standard envisions these data 
services being transmitted as asynchronous, synchronous, or 
synchronized streaming and non-streaming data. 

In the transmitter 2 the source data streams 6 are pro- 
cessed in application encoders 8 which perform data encod- 

35 ing and form atting required before transmission. Application 
encoders 8 include data servers for anciUary data elementary 
streams. The digital television system employs compression 
techniques from the MPEG-2 toolkit and the video stream 
syntax specified in the MPEG-2 standard, ISO/lEC 13818-1, 

40 INFORMATION TCCHNOLOGY-<}ENERIC CODING 
OF MOVING PICTURES AND ASSOCIATED AUDIO 
INFORMATION, International Standards Organization, 
1995. Audio coding is in accordance with the DIGITAL 
AUDIO COMPRESSION STANDARD (AC-3), Advanced 

45 Television Systems Committee, Doc A/52, Nov. 16, 1994, 
Dec. 20, 1995. The data servers generate data packets 
according to the protocol encapsulation, packetization 
layers, synchronization layers, and protection layers defined 
in the draft ATSC T3S13 DATA BROADCAST SPECIFI- 

50 CATION. The encoded and formatted elementary bit 
streams 10 are passed to the transport packetization and 
multiplexing subsystem 12 where each of the elementary 
data streams 10 is divided into packets. Input of a program 
element to the transport packetization and multiplexing unit 

55 is in accordance with the limitations imposed by the trans- 
port system target decoder model 31 associated with that 
program element. For example, transport packetization and 
multiplexing of ancillary services information is in accor- 
dance with the limitations imposed by the ancillary services 

60 system target decoder model described herein. This includes 
conditions to prevent overflow and underflow of data and an 
excessive data transfer rate to the receiver. Timing informa- 
tion is included in the packets of the elementary streams and 
the several packetized elementary streams are multiplexed 

65 into a single transport bit stream 14. The data encoding and 
packetization are synchronized by a system clock 18. The 
transport bit stream 14 is passed to a modem subsystem 20 
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for transmission. In terrestrial broadcast television the 
modem subsystem 20 may be a radio frequency transmission 
system which uses the digital data in the transport stream to 
modulate a transmitted signal 22, Other modem systems 
could be used for satellite or cable transmission and, at least 5 
some, systems are expected to include two-way communi- 
cation for interactivity. 

The transmitted signal 22 is received by a modem sub- 
system 24 in the receiver 4. The transport data stream 26 
with enor signaling is forwarded to the transport depack- 
etization and demultiplexing subsystem 28 where the 
elementary bit streams 30 for each of the program elements 
are demultiplexed and recovered from the transport data 
stream 26. The buffers 31 of the transport stream system 
target decoders, which include individual target decoders for 15 
the video, audio, system data and ancillary data streams, link 
the transport demultiplexing system 28 with the application 
decoders 32. In the application decoders 32 streams of 
consecutive elementary audio, video, and ancillary data 
access units are decoded and reassembled into elementary 20 
data streams 34, The elementary data streams 34 are for- 
warded to the presentation subsystem 36 for display, sound 
generation or other action. Decoding and presentation of the 
program elements are coordinated by a system clock control 
38 which is derived from the program clock references ^5 
(PCRs) transmitted in the bit stream 14, 

Referring to FIG. 2, the buffers of the ancillary service 
target decoder for synchronized data services 40 of the 
present invention link the transport stream demultiplexer 42 
and the application decoder 43 for a synchronized ancillary 
data service data stream 44. The transport demultiplexer 42 
separates the transport bit stream 41 into streams of transport 
packets for each of the program elements which can include 
a data stream for video 46 and one or more streams for audio 
48, system data 50 and ancillary data services 44 and 52. The 
transport demultiplexer 42 directs the data in each of the 
transport packet data streams to a transport system target 
decoder for that stream. In the ancillary data service target 
decoder for synchronized data services 40, complete trans- 
port data packets as indicated by the packet identifier (PID) 
in the transport packet header are passed to the transport 
buffer 54 at the transport stream rate. Packets transferred to 
the transport buffer 54 include duplicate packets and packets 
without payloads. The purpose of the transport buffer is to 
prevent transmission of large bursts of transport packets 
pertaining to the same program element. Consistent with the 
ISO transport system target decoder model, the size of the 
transport buffer 54 of the ancillary services target decoder 
for synchronized data services 40 is 512 bytes. 

The draft ATSC DATA BROADCAST SPECIFICAHON ^° 
includes the definition of data service profiles and levels for 
DW systems, lliese capabilities are signaled in a data 
broadcast descriptor structure in an event information table 
or data information table of the ATSC program and system 
information protocol (PSIP), The maximum data rate of a 
receiver varies according to an MPEG-2 specified data 
service profile, as follows: 



Data Service Profile 


Gl 


G2 


G3 


Al 


Maximum Data Rate 


383,896 bps 


3,838,960 bps 


19.2 


19.2 




Mbps 


Mbps 
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If there is data in the transport buffer, the data is removed 
from the transport buffer 54 at a rate of 1.2 times the 
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maximum data rate of the system as identified by the 
MPEG-2 data service profile for the broadcast. In the 
transport system target decoder of the present invention, the 
transport buffer 54 is not permitted to overflow to prevent 
loss of data. This constraint must be taken into account by 
the data server of the emission station so that no ancillary 
service transport packet is inserted into the multiplexer that 
could trigger an overflow in the transport buffer 54. 

Data bytes 55 in the transport buffer 54 that are part of an 
ISO/IEC 13818-1 packetized elementary stream (PES) 
packet or an ISO/IEC 13818-6 digital storage media com- 
mand and control (DSM-CC) section are transferred to a 
smoothing buffer 56. Other bytes in the transport stream 
packet and duplicate packets are not included in the data 55 
transferred to the smoothing buffer 56. The smoothing buffer 
is not permitted to overflow. The size of the smoothing 
buffer may be determined by descriptors in the bit stream 26 
but is typically 4096 bytes for the ancillary service target 
decoder 40. 

All data bytes 60 of data elementary stream packets of a 
synchronized data service elementary data stream are passed 
to the data elementary buffer 58 from the output of the 
smoothing buffer 56. The data elementary buffer 58 is a first 
in — first out buffer from which all bytes representing a data 
access unit of a streaming synchronized data service are 
removed at the time specified by the presentation time stamp 
(PTS) of the elementary stream packet, assuming that 
decoding of the data access unit is instantaneous. Once 
decoded, each data access unit is presented at the time 
specified by the presentation time stamp (PTS) value asso- 
ciated with the data access unit. Presentation includes any 
action triggered at the time specified by the PTS, including 
display on a monitor. Presentation of the data access unit is 
synchronized with the audio and video content of the 
program presented at same PTS instant. 

Since decoding is not, in reality, instantaneous, a data 
access unit must be removed from the data elementary 
stream buffer at a time earlier than the time specified for 
presentation to allow for decoding. For streaming synchro- 
nized data elementary streams, a data access unit may be 
removed from the data elementary stream buffer as early as 
the time specified by the PTS for the previous data access 
unit in effect the DTS of a data access unit, may be 
considered to be equal to the PTS of the previous access unit. 
For non-streaming synchronized data elementary streams, 
data access units are removed from the data elementary 
buffer at a time explicitly or implicitly specified for that data 
access unit. A decoding time stamp (DTS) in the bit stream 
and associated with the data access unit may be used for 
explicit specification of decoding time. Implicit specification 
of decoding time may be accomplished by a global offset 
signaled outside of the data elementary stream that specifies 
the time before the appropriate PTS for removing the data 
access unit from the data elementary buffer. The decoding 
time associated with any data access unit is only an indica- 
tion of the actual time required and receivers may take an 
access unit at a later time if the receiver has sufficient 
computing capability to perform decoding in a lesser amount 
of time. 

The present inventor reahzed that a data elementary buffer 
that is not allowed to overflow would set an upper limit on 
the size of the basic data unit of the elementary data stream 
(the data access unit). Data loss occurs if the data elementary 
buffer should overflow and, therefore, data is not transferred 
from the smoothing buffer 56 if the data elementary buffer 
58 is full. Further, the data elementary buffer imposes a 
transmission schedule on the multiplexer of the transmitter 
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causing time sensitive broadcast data to be delivered to the 58 at a leak rate which is function of the maximum data rate 

receiver in a controlled fashion. For example, if the data of the system for the data services profile. The maximum 

elementary buffer is not permitted to underflow, a data terrestrial data rate is approximately 19.2 Mbps (allowing 

access unit must have been received in full before it is for overhead in the transport stream). A smoothing buffer 

removed from the buffer. A no underflow constraint in the 5 leak rate of 19.2 Mbps is adequate for systems incorporating 

receiver, therefore, requires that complete data access units the maximum data transmission rate but excessive for a 

be delivered to the data decoder 43. In addition, restricting system with a Gl service profile with a maximum data rate 

the time between the PTS of two consecutive data access of 384 Kbps. Additional data capacity can be incorporated 

units in the data elementary buffer guarantees a maximum into the data elementary buffer to accommodate different 

data transfer capability (throughput) in the receiver. Such a 10 levels of data services with higher data transfer rates, 

restriction is desirable to establish the speed of the receiver's All the references cited herein are incorporated by refer- 

hardware or the speed of the interfaces forwarding data ence. 

access units to external devices. The maximum rate of data The terms and expressions that have been employed in the 

transfer from the data elementary buffer 58 to the ancillary foregoing specification are used as terms of description and 

data service application decoder 43 is determined by mini- 15 not of limitation, and there is no intention, in the use of such 

mum time that must elapse between the PTS of two con- terms and expressions, of excluding equivalents of the 

secutive data access units. To take advantage of a variety of features shown and described or portions thereof, it being 

potential output devices, including television and computer recognized that the scope of the invention is defined and 

monitors, this time is set at 5.561111 milhseconds in the limited only by the claims that follow. 

ATSC DATA BROADCAST SPECIFICATION so that the 20 What is claimed is: 

maximum leak rate should not exceed 200 Mbps for an IEEE 1. A buffer mechanism to regulate delivery of data for 

1394 data bus. synchronized presentation by a digital television receiver 

The data in the synchronized ancillary data services that includes a smoothing buffer, said buffer mechanism 

elementary stream is to be displayed in synchronized asso- comprising a data elementary buffer constrained to operate 

ciation with a particular instant in another elementary 25 without overflow and underflow of said data, to receive said 

stream, most likely the video stream. Therefore, the inventor data from said smoothing buffer, wherein a data capacity of 

concluded that the size of the nominal data access unit and said data elementary buffer is, at least, approximately three 

the data elementary buffer 58 should be a function of the times a maximum quantity of said data that can be received 

quantity of data that the system can receive during a refer- by said receiver in a period of display of a video element by 

ence period of significance to the video data stream. As an 30 said receiver. 

example, the video frame rate of the DTV system is 30 2. The buffer mechanism of claim 1 wherein a data 

frames per second. For the data related to a synchronized capacity of said data elementary buffer is a function of a 

data service to remain synchronized with the video, the quantity of said data that can be received by said receiver in 

quantity of data in a unit to be decoded for display with a a period of display of a video element by said receiver, 

frame of video or a data access unit cannot exceed the 35 wherein said video element is a video frame, 

maximum data rate of the system multiplied by the frame 3. The buffer mechanism of claim 1 wherein a data 

period (VSoth sec). For a system capable of a data service capacity of said data elementary buffer is a function of a 

maximum bit rate of 19.2 Mbps, the maximum size of a data quantity of said data that can be received by said receiver in 

access unit synchronized to the frame rate is approximately a period of display of a video element by said receiver, 

80 KBytes (^A)sec.xl9.2 Mbps). Likewise, nominal data 40 wherein said video element is a video field, 

access units could be sized for association with some 4. A target system decoder for a synchronized ancillary 

division or multiple of the frame rate. Sizing the data access data service for a digital television receiver comprising: 

unit for transmission at the field rate of the DTV system (60 . . ^ transport buffer receiving a first plurality of transport 

fields per second) results in a data access unit of 40,040 stream data packets for said synchronized ancillary data 

bytes with a nominal frequency of 59.94 Hz at 19.2 Mbps. 45 ^^.^ ^ transport stream demultiplexer; 

To handle data at this rate the mmunum leak rate required at . . . , «- - . j , i • r 

the output of the data-elementary buffer 58 is 172.8 Mbps. (^) ^ s°^oothmg buffer receiving a second plurahty of 

-nie size of the data elementary buffer 58 is derived from ^^^°«P^^ '""^^^ data packets from said transport buffer 

the size of a data access unit and the desired function of the ^ transport butter leak rate, 

buffer. The inventor concluded that the minimum size of the 50 (c) a first-in, first-out data elementary buffer, constrained 

data elementary buffer 58 for proper functioning should be to operate without overflow and underflow of data, 

three nominal data access units. ^Hierefore, the minimum receiving elementary data stream packet data from said 

size of the data elementary buffer 58 is 120,120 bytes. A smoothing buffer at a smoothing buffer leak rate and 

buffer of this size permits a first data access unit to be in the aggregating said elementary data stream packet data to 

process of being removed from the buffer, a second data 55 reconstruct a data access unit; and 

access unit to be held ready, and a third data access unit to (d) an application decoder receiving said data access unit 

be in the process of being input to the buffer. In the ancillary from said data elementary buffer at a specified admis- 

data services data elementary stream, the size of data access sion time, wherein a data capacity of said data elemen- 

units can vary as long as no overflow or underflow of the tary buffer is, at least, approximately three times a 

data elementary buffer occurs. If a transport stream contains 60 maximum quantity of said data that can be received by 

multiple synchronized data elementary streams and these said receiver in a period of display of a video element 

data streams belong to the same data service, the data by said receiver. 

elementary buffer is divided equally to accommodate the 5. The target system decoder of claim 4 wherein a data 

acquisition and reconstruction of the data access units of capacity of said data elementary buffer is a function of a 

each stream. 65 quantity of said data that can be received by said receiver in 

If the data elementary buffer is not fuU, data is transferred a period of display of a video element by said receiver, 

from the smoothing buffer 56 to the data elementary buffer wherein said video element is a video frame. 
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6. The target system decoder of claim 4 wherein a data 
capacity of said data elementary buffer is a function of a 
quantity of said data that can be received by said receiver in 
a period of display of a video element by said receiver, 
wherein said video element is a video field, ^ 

7. A method of buffering data for synchronized presenta- 
tion with an instant of at least one of a visual and an audio 
data stream by a digital televison receiver comprising: 

(a) setting an appropriate size for a data elementary buffer lo 
aggregating data to reconstruct a access unit of data, 
said data elementary buffer constrained to operate 
without overflow or underflow of data; 

(b) removing said access unit of data from said data 
elementary buffer for presentation at a removal time 
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correlated with a presentation time stamp included in 
said at least one of a visual and an audio data stream; 
and 

(c) adding said data to said data elementary buffer from a 
smoothing buffer, wherein said appropriate size of said 
data elementary buffer is, at least, approximately three 
times a maximum quantity of said data that can be 
received by said receiver in a period of display of a 
video element by said receiver. 

8. The method of claim 7 wherein said video element is 
a video frame. 

9. The method of claim 7 wherein said video element is 
a video field. 
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